Action Recognition Using Visual-Neuron Feature

Action Recognition Using Visual-Neuron Feature of Motion-Salience Region

This paper proposes a shape-based neurobiological approach for action recognition. Our work is motivated by the successful quantitative model for the organization of the shape pathways in primate visual cortex. In our approach the motion-salience region (MSR) is firstly extracted from the sequential silhouettes of an action. Then, the MSR is represented by simulating the static object represent...

Action Recognition using Visual Attention

We propose a soft attention based model for the task of action recognition in videos. We use multi-layered Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units which are deep both spatially and temporally. Our model learns to focus selectively on parts of the video frames and classifies videos after taking a few glimpses. The model essentially learns which parts in the fram...

The mirror-neuron system and action recognition

The mirror neuron system and action recognition.

Mirror neurons, first described in the rostral part of monkey ventral premotor cortex (area F5), discharge both when the animal performs a goal-directed hand action and when it observes another individual performing the same or a similar action. More recently, in the same area mirror neurons responding to the observation of mouth actions have been also found. In humans, through an fMRI study, i...

Audiovisual Facial Action Unit Recognition using Feature Level Fusion

Recognizing facial actions is challenging, especially when they are accompanied with speech. Instead of employing information solely from the visual channel, this work aims to exploit information from both visual and audio channels in recognizing speech-related facial action units (AUs). In this work, two feature-level fusion methods are proposed. The first method is based on a kind of human-cr...